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(57)Abstract: 

PURPOSE: To expand the dynamic range of the image pickup of an 
image by making an image memory minimum by picking up image by 
continuously dividing the dynamic range of the brightness value of 
an image to be determined in order of the increase of the 
brightness value. 

CONSTITUTION: A loopup table 3 inputs digital signal data to be 
outputted from an A/D converter 2 and outputs signal data after 
non-linearity is corrected. A write decision device 4 receives the 
signal data to be outputted by the lookup table 3 and decides 
whether the signal data of each picture element is written in an 
image memory 6 or not. When it decides to write, a write pulse is 
generated and the data is made to be written in the image memory 
6 via a lookup table 5. The lookup table 5 outputs the result which 
the inputted signal data is multiplied by the magnification based on 
the exposure value at the time of the image pickup to be fixed by 
the signal from a control device 7. 
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<* NOTICES * 

JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 



LThis document has been translated by computer. So the translation may not reflect the original precisely. 

2 -**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



CLAIMS 



[ClaimCs)] ~ ~~ ~ 

[Claim 1]An imaging device comprising: 
An image sensor which picturizes an object 

ln£d~^ ' Vid6 ° Signa ' WNch Said ~»~ «* every pixe., and is 

A light exposure control means which controls a light exposure of said image sensor to at least two steps 
An .mag,ng control means which controls an image memory, and said light exposure o^^TJStJd 
.mage sensor for memorizing a lightness value on an image face corresponding to a pixel and pfcturizes 
sa.d object one by one w,th a light exposure set up gradually. Each division range produced Tby ^dividing a 
dynamic range of sa.d hghtness value continuously in order of the increase in a tightness value ^made to 
correspond ,n order of reduction of each of said light exposure. A range setting-out means to set up sa^d 

:i"T ° r an out P"t range of an image sensor corresponding to the divisTon range for said every ight 
exposure. A convers.cn method wh.ch changes said output value of an A/D converter into a value inT 

SH Z n J!Tu°° rre lT t0 I " ght eXP ° SUre bV USing 3 Hght exposure as a scale ^ctor at the time of 
the .mage p,ck-up at the t,me of an .mage pick-up. A range judging means which judges whether a 
convers,on value outputted from an output value outputted for every pixel from said A/D converter or said 
convers.on method ex.sts ,n an output range or a division range corresponding to a light exposure at the 
t.me of an .mage pick-up A storage control means which memorizes a conversion value obtained by sa.d 
convers,on method ,„ sa.d image memory to an address corresponding to output picture elements for ?he 
convers.on value only when a decision result of said range judging means is affirmed 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Industrial Application]This invention relates to imaging devices to which the dynamic range of the image 
[0002] * t0 6Xtend ' SU ° h 38 3 Vid6 ° ° amera a " e,ectronic camera - 

[Description of the Prior Art]Generally the dynamic range of an image sensor becomes settled in the ratio 
of the no.se evel of an output s.gnal, and a saturation level. When the dynamic range of the brightness for 
an ,mage p,ck-up is large compared with the dynamic range of the output of an image sensor it is 
necessary to adjust the light exposure of an image sensor. In this case, a picture with a dynamic range 
larger than the dynam.c range of the output of an image sensor can be acquired by, forming a means to 
adjust light exposures, such as illumination intensity, the amount of diaphragms, shutter speed and 
picWinTit ° f 3 fi ' ter ' eXamP ' e ' chan * in e a "e ht exposure to a multi stage story, and 

[0003]There is the method of changing exposure parameters to a three-stage and picturizing them as 
tn7Z Z te t ch " olo gy which realizes this, for example. Namely, picturize by the 1st exposure parameters 

bv the 2nd ~ 6 aCqU ' red + by th ' S 'T g o P l C k " UP iS memorized t0 th * 1 *t ^age memory, Next picturize 
?L iL P 1 ' , parameters and the 2nd picture acquired by this image pick-up is memorized to the 
2nd .mage memory Next . .t p.ctur.zes by the 3rd exposure parameters and a wide dynamic range image is 
generated by comb.n.ng the 1st picture and the 2nd picture which are memorized by the 3rd picture and 

[0004] ' mage mem0ry ' an<J image mem0ry WhiGh W6re ° btained by this image P ick " u P 

[Problem(s) to be Solved by the Invention]However. in this conventional technology, since it is necessary 

£i„777° " ^ P,CtU T d ^ diff6rent eXP ° SUre P arame ^ ^e image memory of an individual 
(k.nd-1 of exposure parameters) .s needed. Therefore, there was a problem that a device became large 
S.nce .t .s a method with wh.ch one wide dynamic range image is obtained in the above-mentioned method 
whenever the image p.ck-up of 1 set of exposure parameters is completed (when the image pick-up by 

h£Z S r°? ^ POSUre Paramet6rS ? com P |eted in the above-mentioned example). When it applied to the 
-mage p.ck-up of a movable matter object, there was a problem that it was difficult to obtain the wide 
dynam.c range .mage of a v.deo rate required to reproduce a smooth motion. 
[0005] 

[Means for Solving the Problem]Composition of an invention for solving an aforementioned problem An 
.mage sensor and an A/D converter. A light exposure control means which controls a light exposure of an 
.mage sensor to at least two steps. An imaging control means which controls an image memo^ and a light 
exposure control means and an image sensor for memorizing a lightness value on an image fa7e 
corresponds to a p.xel and picturizes an object one by one with a light exposure set up gradually Each 
d.vs.on range produced by d.viding a dynamic range of a lightness value continuously in order of the 
.ncrease ,n a l.ghtness value is made to correspond in order of reduction of each light exposure A range 
sett.ng-out means to set up a division range or an output range of an image sensor corresponding to the 
d.v,s.on range for every light exposure. A conversion method which changes an output value of an A/D 

tZZ e £cto?°t th^^ 'f d i ViSi ° n ranEe , corres P° ndin e to a W e *P°^re by using a light exposure as a 
scale factor at the t.me of the .mage p.ck-up at the time of an image pick-up. A range judging means which 
judges whether a conversion value outputted from an output value outputted for every pixe froJ Tan Zd 
converter or a convers.on method exists in an output range or a division range corresponding to a lighT 
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exposure at the time of an .mage p.ck-up, Only when a decision result of a range judging means is affirmed, 
it is having established a storage control means which memorizes a conversion value obtained by a 
conversion method in an image memory to an address corresponding to output picture elements for the 
conversion value. 
[0006] 

[Function]As shown in drawing 3 , the dynamic range (extended dynamic range) of the lightness value of a 
picture for which it asks is continuously divided in order of the increase in a lightness value and each 
division range is obtained. Hereafter, it is called the 1st division range, the 2nd division range, and - in this 
order. Each of this division range corresponds in order of reduction in a light exposure in order of the 
increase in a lightness value. Hereafter, a light exposure is called the 1st light exposure, the 2nd light 
exposure, and - in order of reduction. That is, the 1st division range, the 2nd division range, and the 
lightness value of - are calculated from the 1st light exposure, the 2nd light exposure, and the image pick 
in — , respectively. 

[0007]On the other hand, as shown in drawing 3, the output range of an image sensor exists corresponding 
to the 1st d.v.s.on range, the 2nd division range, and -. Hereafter, it is called the 1st output range the 2nd 
output range, and — in this order. The correspondence relation between a division range and an output 
range can be set as the following relation as an example. More than the noise level (the minimum output 
signal leve from which S/N to need is obtained) of an image sensor can use the 1st output range as a 
saturation evel (upper limit of the range with linearity distinguishable from the state where it was saturated 
thoroughly;. The value which performed conversion to a reference light exposure from the 1st light 
exposure is equivalent to the value of the 1st division range in the value of this 1st output range Thus the 
1st division range is determined. The value which performed conversion to a reference light exposure from 
the 2nd light exposure corresponds the maximum (generally saturation level) of the 2nd output range to the 
maximum of the 2nd division range, and the 2nd division range is set up so that the minimum of the 2nd 
division range may become equal to the maximum of the 1 st division range. The minimum of the 2nd output 
range makes the minimum of the 2nd division range the value changed into the 2nd light exposure from the 
reference light exposure. 

[0008]Each output range of an image sensor, each division range, and a correspondence relation with each 
hght exposure can be set as the above relation. As especially shown in drawing 8 . each light exposure can 
be set up and each division range can also be set to each of that light exposure from the communalized 
output range communal.ze each output range from a noise level to the total range of a saturation level 
That is the 2nd light exposure, the 3rd light exposure, and — can be determined that the 2nd division ' 
range, the 3rd d.v.s.on range, and the value of — for which the minimum was changed into the 2nd light 
exposure, the 3rd light : exposure, and - from the reference light exposure will serve as a noise level of an 
output range, and each division range can be determined. 

[0009]Like the 1st light exposure, the 2nd light exposure, the - n-th light exposure, the 1st light exposure 
and — , each l.ght exposure changes periodically one by one. and is picturized by the imaging control means 
correspond.ng to each l.ght exposure. An image pick-up order hopes that it is not periodic. The output 
value outputted one by one for every pixel from an A/D converter is changed into a reference light 
exposure from a l.ght exposure at the time of an image pick-up. This changed value is hereafter called 
conversion value. 

[0010]When it picturizes with the 1st light exposure, the output value or conversion value outputted one bv 
one for every p.xel from an A/D converter exists in the 1 st output range or the 1 st division range or no is 
judged S.m.larly, when .t picturizes with the 2nd light exposure, the output value or conversion value 
outputted one by one for every pixel from an A/D converter exists in the 2nd output range or the 2nd 
d.v.s.on range, or no is judged. And a conversion value is memorized by the image memory of the address 
corresponding to output picture elements only when a decision result is affirmative. That is when it 
j*ctur.zes W .' th th / J st light exposure, in an image memory, only the lightness value of the pixel which has a 
lightness value of the 1st d.v.s.on range is rewritten. Similarly, when it picturizes with the 2nd light 
exposure, .n an .mage memory, only the lightness value of the pixel which has a lightness value of the 2nd 
division range is rewritten. 

[001-llThus, whenever it is picturized one by one with the 1st light exposure, the 2nd light exposure and 
the n-th light exposure, in an image memory, only the lightness value of the pixel which has a lightness 
value of the 1st d.v.sion range, the 2nd division range, and the — n-th division range can rewrite and 
repeat execution of the above-mentioned processing is carried out. The picture of the extended 'dynamic 
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[00?2] iS * aCqU ' red ty referring to the va,ue of this ima ge memory at arbitrary time. 

[Effect of the InventionjAs mentioned above, by this invention, the shade image which has the dynamic 
range to which arbitrary time was expanded can be obtained by providing one image memory to an imaging 
screen. Therefore, a dev.ce can be miniaturized. Since the value of the image memory is serially rewritten 
for every division range, even if the value of an image memory is referred to at arbitrary time it can 
acquire the information on the animation which changes smoothlv 
[0013] 

[Example]Hereafter, this invention is explained based on a concrete example. In drawing 1 the image 
sensor 1 is a controllable image sensor by an electrical signal about the storage time of the electric charge 
generated with a photoelectric conversion mechanism. 

Specifically, it is a CCD image sensor with an electronic shutter function from which a two-dimensional 
picture is acquired. 

Therefore, in this example, exposure parameters (light exposure) are given by the storage time of an 
electron.c shutter function. Therefore, in this example, the light exposure control means and the image 
sensor are incorporated in one as a CCD image sensor. Image formation of the picture is carried out to the 
acceptance surface of the image sensor by the optical system of the lens etc. which are not illustrated in 
the case of a camera. 

[001 4] A/D converter 2 samples the signal level of the analog signal read from the image sensor 1 by a pixel 
unit, and changes it into digital signal data. The look-up table 3 has memorized beforehand the correction 
factor for amending the nonlinearity of the image sensor 1 by an optical system 

The digital signal data outputted from A/D converter 2 is inputted, and the digital signal data (digital value) 
in which nonlinearity was amended is outputted. 

[0015]The write-in judging device 4 which constitutes a range setting-out means, a range judging means 
a l I !u° r f ge , contro ' means - lt is a de vice performed by the method of receiving the digital signal data ' 
which the look-up table 3 outputs, and mentioning the judgment of whether to write this in the image 
memory 6 later about the digital signal data of each of that pixel. When it judges with the data which should 
be written in, the wnte-.n judging device 4, When the data is changed by the look-up table 5 and given to 
the data input terminal of the image memory 6, a writing pulse is generated to the image memory 6 and the 
data is a device written in the image memory 6. ' 
[0016]The look-up table 5 which constitutes a conversion method is constituted so that the result of 
having multiplied by the magnification based on a light exposure at the time of the image pick-up provided 
in the inputted digital signal data by the signal from the control device 7 may be outputted The image 
memory 6 is a bit map format image memory holding the wide dynamic range image generated by this 
device. The control device 7 which constitutes an imaging control means mainly controls each exposure 
time periodically. H 

It is a device which controls the image sensor 1, the write-in judging device 4, the look-up table 5 etc and 
makes the image memory 6 generate a wide dynamic range image. 

[0017]This device operates as follows by control of the control device 7. A timing chart is shown in drawing 
£ about the case where an image pick-up pixel number is 4x3 pixels. First, the image sensor 1 picturiz^sTy 
the 1 st storage time T1 that determines the 1 st light exposure according to the signal which controls 
accumulation timing with the storage time length outputted from the control device 7. The analog picture 
signal data obta.ned by this image pick-up is serially read from the image sensor 1 one by one by a pixel 
unit by the control signal from the control device 7, and the following processings are performed about 
these picture element data of a series of. 

[0018]The analog picture signal data (video signal) from the image sensor 1 is transmitted to A/D 
converter 2 one by one and is changed into digital-signal-data D' (x, y) by a pixel unit with A/D converter 
2 according to the sampling signal outputted from the control device 7. Here, (x. y) show the coordinates 
position on the image face of this pixel. Digital-signal-data D' (x, y) after the A/D conversion outputted 
from A/D converter 2 is changed into the data D (x, y) in which it was transmitted to the look-up table 3 
and the nonlinearity of the image sensor 1 was amended. The data D (x, y) in which nonlinearity was 
amended is transmitted to the write-in judging device 4 from the look-up table 3. The write-in judging 
device 4 is told that the data transmitted to the write-in judging device 4 is data of the storage time T1 by 
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the storage time length signal from the control device 7. 

[001 9]The write-in judging device 4 will judge whether according to the determination timing signal 
outputted for every pixel the conditions of Rmin(T1) <=D(x. y) <=Rmax (T1) are satisfied from the control 
device 7, if the data of D (x y) is received from the look-up table 3. Here, as shown in drawing 2. Rmin and 
IT1 ) Rmax (T1) are values deeded corresponding to the image pick of the storage time T1. That is it is the 
mmimum and the maximum of the 1 st output range of the image sensor 1 corresponding to the 1 st light 
exposure When judged with the above-mentioned conditions being satisfied in the write-in judging device 
4 the data of D (x. y) is changed by the look-up table 5 so that it may mention later. And in the timing by 
which the translation data (conversion value) is given to the data input terminal of the image memory 6 the 
write-in judging device 4 generates a writing pulse to the image memory 6. 

[0020]The data D (x, y) inputted into the write-in judging device 4 is transmitted to the look-up table 5 
The look-up table 5 is told that the data transmitted to the look-up table 5 is data of the storage time T1 
by the storage time length signal from the control device 7. The look-up table 5 will output the data 
(conversion value to the 1st division range converted into the reference light exposure) of A(T1) xD (x v) 
which carried out it A (T1) double to the data input terminal of the image memory 6, if the data of D (x y) 
is inputted. Here, A (T1 ) is a value decided corresponding to the storage time T1 

It is a scale factor for changing the output value of the image sensor 1 into the value (value of the 1st 
division range) in a standard exposed state. ~ " " * ' 

Synchronizing with the data of A(T1 ) xD (x, y) which exists in the 1 st division range being given to the data 
input terminal of the image memory 6, the memory address which corresponds to the pixel (x y) of the 

Whfnth! 7? 6 / r A°rTi t ^ e n C r tr ? 1 d6ViCe 7 iS giV6n t0 tHe mem0ry address terminal of the ima * e memory 6. 
When the data of A(T1) xD (x, y) was given to the data input terminal of the image memory 6 and a writing 

pulse .s generated from the write-in judging device 4, this data is written in the address equivalent to the 
picture element position (x, y) of the image memory 6. 

[0021]After above-mentioned processing finishes about a series of picture element data picturized by the 
. IT ?* ■ ". ght exposure) next - according to the signal which controls the next storage time 
length and accumulate timing of a control cycle from the control device 7, it picturizes with the image 
sensor 1 by the 2nd storage time T2 (the 2nd light exposure). The picture acquired by this image pick-up is 
serially read from the image sensor 1 for every pixel one by one like the case of the image pick-up by the 
1st storage time, and the processing same about these picture element data of a series of as the case of 
the storage time T1 is performed. With however, the storage time length signal which is outputted to the 
wnte-in judging device 4 from the control device 7 in the case of the storage time T2. With that Rmin (T1 ) 
and Rmax (T1) turn into Rmin (T2) and Rmax (T2) in the write-in judging device 4, and the storage time 
length signal outputted to the look-up table 5 from the control device 7. It differs from the case where it is 
the storage time T1 that A (T1) turns into A (T2) in the scale factor in the look-up table 5 RmfnT^ and 
Rmax (T2) are the m.n.mums and the maximums of the 2nd output range. A (T2) is a value decided 
corresponding to the storage time T2. 

It is a scale factor for changing the output value of the image sensor 1 into the value (value of the 2nd 
division range) in a standard exposed state. 

[0022]By performing the above operation, a wide dynamic range image is generable to the image memory 6 
It explains below with the example of how to decide each above-mentioned constant for this principle In ' 
the state after nonlineanty was amended for the output signal of now. for example, an image sensor by the 
look-up table 3. a zero level (output of an incident light intensity zero state when noise is disregarded) is 0 
and suppose that a saturation level is Dmax. And linearity shall be maintained between 0 and Dmax A ' 
[0023]" St ° rage t,me T1 72 preSupposes that il is T1>T2 - At this «ma. ^ is each constant. 

[Equation 1] 

S^i™ °' Rmax(T1) =D max-1, Rmin =(T2) Dmax xT2/T1. Rmax =(T2) Dmax. A(T1) = 1, A(T2) =T1/T2 
L0024JIf .t sets, as shown in drawing 2 . the picture by which the pixel (dark portion) to which a lightness 
value exists in the 1st division range was picturized by the storage time T1 (the 1st light exposure) will be 
used, The picture by which the pixel (bright portion) to which a lightness value exists in the 2nd division 
range was picturized by the storage time T2 (the 2nd light exposure) will be used, and a wide dynamic 
range image will be obtained as a result. When the data D1 when it picturizes by the storage time T1 has 
not reached a saturation level about each pixel (x. y), namely. [ (when it exists in the 1st output range) ] It 



is the image data (since the 1st light exposure is made into the reference light exposure) of that pixel 
about this D1. When it picturizes by the storage time T2, two are data DT1/T Doubled, and D1 is taken as 
the .mage data of the (it becomes a value of the 2nd division range by converting the output value of the 
image sensor 1 into the value in a reference light exposure) pixel, when it presupposes that it is a value of 
* e Jo St range and 01 ' S saturated - D2T1/T The reason to double is that the sensitivity of the data 

of D2 .s T2/T1 time compared with the data of D1 since the signal output of the image sensor at the time 
of the same incident light quantity is proportional to storage time in non-saturation here 
[0025]Value Dmax-1 as used in the above-mentioned formula of Rmax (T1) means as big a value as 
possible in the range to which the image sensor has not reached a saturation level. Since the pixel actually 
buried by the noise of an image sensor etc., motion of an image pick-up object body, etc. by neither of the 
pictures of the storage time T1 and T2 may arise, it is preferred to give the field which piles up Rmin (T2) a 
little as a value somewhat smaller than the value shown above, and is put together. How to decide the 
value of these constants shown here is what showed the fundamental view in this invention, and it is also 
possible to add various modification easily considered by this. 

[0026]When the concrete numerical example of each constant was shown and Dmax =255 takes T1=1 / 60 
seconds, and 600 T2=1 / seconds, it is as an example. [0027] 
[Equation 2] 

Rmin (T1)=0.Rmax (T1)=254,Rmin (T2)=25,Rmax (T2)=255,A(T1)=1,A(T2)=10 [0028]Carrying out is possible 
At this time, in the case of 0 to 254, the data D (x, y) picturized by the storage time T1 (1 / 60 seconds) ' 
generates a writing pulse, this data is written in the image memory 6, and when the data D (x y) is 255 a 
wntmg pulse is not generated. The value which the data D (x, y) picturized by the storage time T2 (1 / 600 
S ?°oT< ni* n0t , f enerate a writin * P ulse in the ca *e of 0 to 24, but generated the writing pulse in the case 
of 25 to 255, and increased this data 10 times will be written in an image memory. Therefore, image data 

^nooiA 6 , 15 SS Va ' Ue ° f the largS dynamic ranEe of 0-2550 is obtained by the image memory 
L0029JAIthough the above explanation described the operation which obtains a wide dynamic range image 
by performing a series of operations of the storage time T1 , continuing, and performing a series of 
operations of the storage time T2. it is possible by operating this device as follows to picturize a movable 
matter object and to obtain video. 

[0030]That is. it is made to repeat operation as are shown in drawing 7 . and a series of operations of the 
storage time T2 are performed, and a series of operations of the storage time T1 are performed again and 
it continues [ a series of operations of the storage time T1 are performed, and ] continuously and a series 
of operations of the storage time T2 are performed. Then, when a movable matter object etc. are made 
applicable to an image p.ck-up, the wide dynamic range image equivalent to it is generated by the image 
memory 6 as v.deo updated with the time interval which picturizes. Therefore, the video signal of an 
extensive dynamic range can be acquired by arranging the contents of the image memory 6 in parallel with 
wnte operation and reading as a video signal with a video rate. Since rewriting of the contents of the image 
memory 6 will be stopped where the contents of the image memory 6 at the time are held by suspending 
the above-mentioned repetitive operation synchronizing with a certain trigger signal at the time, it is also 
possible to acquire the instantaneous picture as a still picture. 

[0031] Although the above explanation explained the case of T1>T2 as an example, when it is TKT2 it is 
said each constant, [Equation 3] ' 

rnn^! 0 ° maX xT1/T2 ' Rmax =(T1 > Dmax . R min =(T2) 0. Rmax =(T2) Dmax-1, A(T1) =T2/T1 A(T2) = 1 
L0032JThen, a good thing is in **. Although storage time was chosen as two kinds T1 and T2 in the 
above-mentioned explanation, it is in ** by increasing the kind of storage time to three or more kinds that 
a larger dynamic range picture can be acquired, for example, when storage time is chosen as three kinds 
Tl, T2. and T3 (the 3rd light exposure) which are mutually different, for example supposing the relation of 
the storage time T1. T2. and T3 is T1>T2>T3. it will come, and is shown in drawing 3 — as [0033] 
[Equation 4] — J 

Rmin =(T1) 0 and Rmax(T1) =Dmax. -1, Rmin =(T2) Dmax xT2/T1, Rmax =(T2) Dmax-1, and Rmin (T3) 
-Umax xT3/T2, and Rmax It is possible to consider it as (T3) =Dmax. A(T1) = 1. and A(T2) =T1-/T2A(T3) 
-T1/T3. Similarly, it is easy to increase the kind of storage time further or to put in and change the turn 
There are not a series of storage time T1. T2. — , the necessity that Tn is not necessarily different from 
each other. 

[0034]Each output range can also be made for more than a noise level (Dmin) to communalize below on a 
saturat.on level (Dmax). as shown in drawing 8 . In this case, storage time (T1>T2>T3) is set up as follows. 
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[0035] ' 
[Equation 5] 

T2=Dmin xT1/DmaxT3=Dmin xT2/Dmax [0036]It is also possible by being made to picturize the following 
storage time in parallel to while processing the data of storage time Ti as a changed completely type of this 
example to shorten an image pick-up interval. . . . 

[0037]It is also possible as another changed completely type of this example to use control of the light 
intensity by the transmission quantity of a diaphragm or a filter, the sensitivity control of the image sensor 
by the other methods, the illumination-light intensity control by a stroboscope, etc. instead of controlling 
storage time for exposure parameters by the electronic shutter of an image sensor. For example, since the 
signal output of an image sensor when the incident light quantity to a filter is the same is proportional to 
the transmissivity of a filter when the transmissivity of light replaces a controllable filter with the electronic 
shutter of the above-mentioned example and uses it electronically. When the transmissivity of a filter is 
changed to U1 and U2 and it is U1>U2, it is said each constant. [0038] 
[Equation 6] 

Dm S ax°A(ui) =°1 ^an^MUl) =UVV2 °' DmaX " 1, Rmin =(U2) Dmax xU2/U1 ' Rmax =(U2 > 

[0039]An image intensifier can be attached to image sensor anterior part as another changed completely 
type of this example. By attaching an image intensifier, there is an advantage to which the sensitivity of an 
imaging device is made to increase. When an image intensifier is attached, control of the storage time by 
the electronic shutter of an image sensor can be used as the control method of exposure parameters but 
it is also possible to use the sensitivity control of an image intensifier as the control method of exposure 
parameters. 

[0040]By it not only multiplying by the constant A (Ti) by the look-up table 5. but changing the value by a 
^* a '" funct,on 33 another chan ged completely type of this example, after multiplying by the constant A 
OU When compress a bright portion relatively, and using the image memory 6 effectively or carrying out 
image processing of the contents of the image memory 6, it is also possible to use desirable form As 
conventional technology which compresses the concentration level of image data, there is a method of loe 
transforming a concentration level. 

[0041]However. there is a problem described below in the conventional method which log transforms a 
concentration level and is memorized to an image memory. Since the value memorized in a memory is 
quantized when log transforming a concentration level and memorizing in a memory, the concentration level 
corresponding to this is also quantized. Since inclination is so large that the graph of the logarithmic 
function log a has [ zero ] near a. in log transforming a concentration level and memorizing in a memory 
the quantization error of a concentration level becomes small, so that a concentration level becomes small 
It is thought that the error fixed for causes, such as a noise component of the generating picture signal of ' 
an imaging dev.ce and a conversion error of an A/D converter, is included in the concentration level itself 
on the other hand. 

[0042]Generally, in the field where a concentration level is large, since the quantization error of a 
concentration level becomes larger than the error of the concentration level itself, do not produce a 
problem, but in the field where a concentration level is small. Since the quantization error of a 
concentration level becomes quite smaller than the error of the concentration level itself, the problem that 
the bit of a memory will be used effectively arises. 

[0043]As a method of solving this problem, it is effective as a function to use Log (Li(x y)+Lo) Here a 
natural logarithmic function and Li (x, y) express the value which multiplied the data D (x y) given to'the 
look-up table 5 by the constant A (Ti), and Log is Li(x, y) =A(Ti) xD (x. y). Lo is a positive constant for 
example a series of storage time is T1>T2>. - It can be referred to as Lo=A(T1) xDmax xT2/T1 when it is 
>Tn. As for the funct.on Log (a+Lo). although a is the almost same graphical form as Log a in a large field 
in the portion near 0, inclination of a graph becomes fixed and inclination of the graph of Log a does not ' 
become large in a. Therefore, it can prevent the quantization error of a concentration level becoming 
smaller than the error of the concentration level itself in the field where a concentration level is small 
Therefore, by using this method, the above-mentioned problem is solvable, the bit of an image memory can 
be saved and the large picture of a dynamic range can be memorized to an image memory. Since it is Loe 
a-Log 10 a/Log 10 e when logarithm is made into Log 10 , Log 10 (Li(x. y)+Lo)/Log 10 e can be used instead of Log 
(Li(x, y)+Lo). However, e is a base of a natural logarithm. 

[0044]It is possible to constitute A/D converter 2 as another changed completely type of this example, so 
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that an' A/D conversion may be performed in logarithm. For example, since the quantization error of the 
concentration level in an image memory becomes large as mentioned above in the field where a 
concentration level is high when carrying out logarithmic transformation and conversion of the above- 
mentioned Log (L.(x, y)+Lo) and memorizing a picture to an image memory, The one where the conversion 
precision of a concentration level m an A/D converter is higher may be low compared with the lower one 
InA/~n a " t converter ~ ^garithm ~ by performing an A/D conversion-like, the number of bits of 
an A/D converter can be used efficiently, and it is effective in the ability to ** if the accuracy of the 

rSSSif'S!! * ^ im ? ing d6ViCe iS raiS6d U5ing the A/D inverter of the same number of bits. 
[0045]If the write-in judging device 4 receives the data of Log (D (x, y)) from the look-up table 3 in this 

sat S i!^H W !f th 'h f f W r rn ? f ° nditions of L °g <=( Rmi " (TO) Log <=(D (x. y)) Log (Rmax (TO) are 
satisfied. If the data of Log (D (x, y)) , s .nputted, the look-up table 5, The data of Log (A (Ti) xD (x y)) 

data" in C D u r t ri t ^ f C ° f * 1 ( ° ^ ^ **• M ^ Lo * < A ™ outputted to the 

data input term.nal of the .mage memory 6.) In changing the above-mentioned Log (A(Ti) xD(x y)+Lo) and 

memorizing a picture to an image memory, in the look-up table 5, it also performs simultaneously 

mXa'Shm 1 th^h ^ l ^ ^ ^ L ° g (A ^ X ° ( *' y)X InSt6ad ° f burning an A/D conversion 
in logarithm so that the above explanation may show easily, It is also possible for it to be made to perform 
an A/D conversion by the function property of the others that the A/D conversion accuracy of the lowe? 
one becomes high compared with the one where a concentration level is higher, and the composition of the 

moS ■ T" g °u ,0 ° k " UP t3ble 5 Wh,Ch Were doubled with * can a,s ° be considered easi y 

[0046]It ,s also poss.b^ to summarize the look-up table 3. the write-in judging device 4, and the look-up 
table 5 , us.ng known art as another changed completely type of this example, and to place and replace 
them with one look-up table. 

[0047]As another changed completely type of this example, as shown in drawing 4 . it is also possible to 
feed back the contents of the ,mage memory 6 to the write-in judging device 4. By this instead of the 
wnte-,n judgmg dev.ce 4 controlling the data write to the image memory 6 by existence of a writing pulse 
It .s a^o possible to constitute so that the data of the previous state of an image memory may be 
outputted, when the data is outputted to the look-up table 5 when it judges with the data which should be 
written in f and that is not right. 

a Tl h6r Changed C ° mp J etely type of this exam P |e - as ^own in drawing 4 . it is also possible to use 
S ^ the 7 age ™ mory 6 ' n orde '' to hold a flag, and to feed back these bits to the write-in judging 
from arfsing P " 0 ab ° Ve ~ mentioned P icture b y controlling a flag by this is able to prevent 

[0049]The case where an auto iris lens is further attached to an above-mentioned example is explained 
ConventionaHy control of the auto iris lens was performed by the output signal of the image sensor 1 
Namely so that a diaphragm of an auto iris lens may be extracted, since the intensity of incident light is 
large when the output signal of the image sensor 1 is large. Since the intensity of incident light was small 

o^L lh TT ° f , the image S6nSOr 1 WaS Sma "' feedback COntro ' of the aut ° W- «» was earned 

out so that a diaphragm of an auto iris lens might be opened 

[0050]Howeyer in this example, in order to change the sensitivity of the image sensor 1 one by one the 
output s,gnal of the image sensor 1 always does not support the intensity of incident light in a similar 
manner Therefore, to this example, there is a problem that control of an auto iris lens is difficult by the 
conventional method. On the other hand, in this example, said video signal from the image memory 6 is a 
signal corresponding to the intensity of incident light. Then, the above-mentioned problem is solvable by 
controlling an auto ,r.s lens by said video signal from the image memory 6 instead of the output signal of 
the .mage sensor • 1 L Since .t becomes possible to adjust automatically the light intensity range which can 
be pictured with this .magmg device by attaching an auto iris lens to this example, and controlling as 
mentioned above .t .s effective in the image pick-up of larger light intensity being attained. 
|0051JIt is possible to set up two kinds of relation between each output range and a division range 
compensate the joint of a division range mutually as shown in drawing 9 . and to use two kinds of this 
division range bv 'turns as another changed completely type of this example. Exposure time by drawing 9 
For example, T1A, T2A. T3A. T1B, T2B. Set it as the order T3B. T1A. T2A. T3A, T1B, T2B T3B~arrd^ 
™ ™ Z6S ° ne by one ' corre sponding to this — respectively — the division range D1A D2A D3a' 
DIB. D2B, D3B D1A. D2A. D3A. D1B. D2B. D3B. and - Image data is rewritten. Sincf the ! joint of a 
division range changes by turns by this method, even if the division range mentioned above makes it pile 
each other up and it lessens a field (or even if you make it pile each other up and it does not take a field) 
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There is an effect which can prevent the problem that the pixel buried by the noise of an image sensor 
K^oTa!^" an ' mage pick_up object bod V- etc - in neithe r of the division ranges arises 
[0u52JAIthough the above example showed the case of the picture signal (monochrome picture signal) of 
one channel, It .s possible to obtain a wide dynamic range image in color by applying this invention to each 
trichromatic picture s.gnal of this color imaging device 1RGB as another changed completely type of this 
example using the image sensor which can picturize a color picture as an image sensor, as shown in 
drawing 5 . 

[0053]Although this example showed the example which digitizes an analog signal with an A/D converter 
and processes with a digital signal, it is also possible to have composition which transposed a part or all of 
these processings to analog signal processing using known art as a changed completely type of this 
example. 

[0054]Although the above example showed the case where a wide dynamic range image was obtained using 
an imagmg device, It is possible to expand the dynamic range of the sensor instead of an image sensor 
more generally using other sensors which can adjust sensitivity by a sensitivity parameter. In this case it 
corresponds to the memory the sensitivity of a sensor is memorized as for the storage time of an image 
sensor, and sensing information is generally remembered to be as for an image memory 
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DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing ll The block diagram showing the composition of the imaging device concerning the 1st concrete 
example of this invention. 

^wing|]The explanatory view showing the relation between each output range and a division range 
I^raw^g^JThe explanatory view showing the relation between each output range and a division range 
LDjawm & lJThe block diagram showing the composition of the imaging device concerning other examples of 
tnis invention. 

t hirmve^ fon^ diagr3m Sh ° Wing ^ COmp ° sition of the ima ^ device concerning other examples of 

iDrawjng 6l The timing chart which showed the operation timing of each unit in the 1 st example 
IDrawmg 71 The t.ming chart which showed the operation timing of each unit in the 1st example' 
eSrMes eXP ' anat0ry V ' eW showin e the re ^n of each output range and division range in other 

[Pxawjng.9lThe explanatory view showing the relation of each output range and division range in other 
examples. 

[Description of Notations] 

1 — Image sensor (an image sensor, a light exposure control means) 

2 — A/D converter 

4 - Write-in judging device (a range judging means, a range setting-out means, storage control means) 

5 — Look-up table (conversion method) 

6 — Image memory 

7 Control device (imaging control means) 
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«, «*.fi*«i$raT 1 , t 2, t 3 ©BBffas, t 1 > 

T2>T3T'fc5tt5tt, B 3 fcjj*-*\fc 5 fc, 
[0 0 3 3] 
[f&4] 
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Rmin (T 1) =0, 

Rmax (T 1 ) = Dmax - 1 , 

Rmin (T2) = Dmax XT2/T1, 

Rmax (T 2) =Dmax - 1 , 

Rmin (T3) =Dmax XT3/T2, 

Rmax (T 3) =Dmax, 

A (Tl) =1, 

A (T 2) =T 1/T 2 

A (T 3) =T 1/T 3 

*3b\ -ii^iaffiTl, T2, Tn 

[0 0 3 4] B8t*ti #fflAi/vy*y 

(Dmin)£i±ttftlU^l/ (Dmax) J^TtC*ii 

>T2>T3) ttft(Dj;5fcR£3ft6 0 
[0 0 3 5] 

T 2 =Dmin XT 1/Dmax 
T3=Dmin XT2/Dmax 

[0036] x, *mmm<o—&i&b it, ifmt 
[o o 3 7] *$mm<D»i<D— m&t it, 

^Ul £U2tC^fc:£-^ ^oUl>U2ffc5i^ 
[0 0 3 8] 

lie] 

Rmin (U 1 ) =0, 

Rmax (U 1 ) =Dmax - 1 , 

Rmin (U2) =Dmax XU2/U1, 

Rmax (U 2 ) =Dmax , 

A (U 1) - 1 , 

A (U2) =U1/U2 

[0039] *mmm<D%\i<D-&i&t lt, 

T#5 0 ^-v^-f ^>i/7r-<rSr8if+Jt5r tie 
^ >Tyi/7r>f7 *SMrWfc»£\ R3fc'*7*-* 



70 

Ut*«#^©If>'t 9 id J; 5 

[0 0 4 0] X, **Jfe^J<OgiJO— ^£ LT, 
Ty^^SftftA (Ti) SrSftrS^^-Cfi* 
<, S»A (Ti) «r*Cfc«fcftr&*^BBftteJ:oT 

itti^^y 6Sr#»u:*iJffl-t-aJ:5lcLfc9, ® 

[0 0 4 1] La^atfu^vSrStsaElftLTBif*^^- 

^ o fciSWi £*{£# as* # v 3ftft ^/wSrat»3E 
4 -5 f5 if ^^ol^Hb|{li6aS/h $ < Tfc 5 D 

[0 0 4 2] — »S^^C5*#V^tB«Ttt, 

[0 0 4 3] r^Ppm^^^i-S^tLT, HS5t£ 
LT, Log (Li (x, y) +Lo) Sr/BV r £ 
S6T*)5o rrx\ Log tt&*S»ftB8«, Li (x, 
y) [4/1- yZTy ^x-^Vv 5 tC^-x. hfrlfclr' — ^ D 
(x, y) ld£#A (Ti) Sr^Cfcffl^^L, Li 
(x, y) =A (Ti) XD (x, y) XhZ Q 4fc, 
L o fijEO^-Cfc 5 , «X.tf— *<D*a«FWdST 1 > 
T2>->Tn©tHo=A (Tl) X Dmax X T 2 
40 /T 1 itS^t^t*l5 0 KllfcLog (a + Lo) J4, 
a^^#v^*^T^4Log a km$WI -yMVZXhZ 
& y a # 0 iCifil^^Ttt^^ 70l^5-^[ : /^ oT 
Log aO^^^C0«f «if*t<*64v\ ffiot, m 

#^>o *ffl*fr&H««rLog 10 £i-S£, Log a = 

so Log 10 a/Log 10 eX&>i>(DX\ Log (Li (x, y) 
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+ Lo) <Oitt> <Q f-Log 10 (Li (x, y) + Lo) / 
Log 10 e IrfflV^rHST-t^. fcfc'LeliiMS 

10 0 4 4] X, #HJf£0ij£>SlJ<E>— ^Jgt LT, A/D 
^&2§2£, *«kttH:A/D*lfcSrn5J:5K«fiRf « 

(Li (x, y) Ho) V>2£&&LXmi&&Wfost*r 

A/D^m^iCfc^T^mWfdA/D^^fTP ^ tic 
tf*T#, ^Cf^tOA/DfMSrftoT, 

[0 0 4 5] ft, C. »&¥U5g3t4«:, /Us/* 7 

yfr— zf;\s3ti*bho% (D (x, y) ) ©f- ^5r§: 
i+&-5t, Log (Rmin (T i ) ) gLog (D (x, 
y) ) SLog (Rraax (T i ) ) <D4kft&l1jtiL-tZ>1>> 

(4, Log (D (x, y) ) Cf-^^JiiSt, -t 

tl&A (Ti) fgfLfcLog (A (Ti) XD (x, 

y) ) COx-*, i-*t3*,Log ( (D (x, y) ) {CLog 

(A (Ti) ) £-Ail£Lfc7*-*3r, it^^i)6© 

^-^A^c-T-jcaj^-r?,, mr^coLog (a (t 

i) XD (x, y) Ho) LTMfeSrMfcy 
^ey i-IEtg-r5#^-[C{i x fryVT y 7* x - 5 icfc 
I^TLog (A (Ti) XD (x, y) ) rt»P>Log (A 

(Ti) XD (x, y) +Lo) ^(D&mhm&flCft 

IZA/D2z&&n oftfrV ic, mm u-<^i«v^icjt 

-<{&v ^<d A/D£&m&&m < * s ± 5 *«ioBBSk# 

ttT-A/D^Sr^5 iptc-T-Sr t f5jj!BT-#>9, 
[0 0 4 6] X, *HJ60lJ(OgiJ©— LT, A-i/* 

[0047] x, if.mMm<r>m<r>— lt, ii4tc 

SS§4#, #ii/-?/u^oc»^'*Etc:J:oT®^^ ; ey 6^co 
WZ£ \stz.5gj-^\z.\% : %:<F)=T — $ % y$ T yr/T — '/jV 5 

[0 0 4 8] *nmm<omff>-&jeb lt. U4ic 
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ft-f-Z>tzlsb{zm\,\ A^ztiib(0\fy h£#i£¥lj£3§4 
T$>5 C 

[ 0 0 4 9 ] ±a£<O3iJg0IJfC N Zblzj— hT4 }) 
7J-h's<y?®mV±o 

[0050] l^ ^mmmxit, mmm^- 1 cdjbs 
m&m* 1 ©ajAfitttAit 

*^JSMfC*f LT(4^5fe^&T*i4^— hT-r y ^ UVX 

^tc^-fsft-^x-feSo ^ - -e, hr-ry^i/^ 
*y e^bOmJiBt'x^-fB-i-tcio-c^ff bz\ i:{c«ty N 
hTi- y ^ L-^X^#(tT_hsE<oi 5lc©JW-rsr tic 
8151" -5 r t^plf|{c:/«c5<OT% i t)i£t^5SSotg^s 

[0 0 5 1] £fc*J£te#JOSijK>-^£ LT, #ttJ^ 

o 2 ii <o co^-fij u v v^^fcffli^s j; 5 (ci-^r. t ^ 
■eisgTfc-So 0ilx.fi. 0 9T®3t^4-T 1 A, T2 
A, T 3 A, TIB, T2B, T 3 B , T 1 A, T2 

A, T3A, TIB, T2B, T3B, - 1 ^ plffiiC© 
£LTH[ft&»lt>£ffl\ rtlid^LT^il-ett, 
l/^'v'DlA, D 2 A, D 3 A, DIB, D2B, D3 

B, D 1 A, D 2 A, D 3 A, DIB, D2B, D3 

B, - <nm&lr-?ZW%mx.ZJ: 9ic-f-5 0 rco^ 

fc^fiJV'>-v :; oa*a-g-^^^/>^< tTt (Sfcil 
*ia^fc*«i«4r t & « < T t> , ) 
^^^W<r>m t^tiotv ^^©^fij u > >?ic <fc 
oTbiftWiV ^HJ*^^ L 5 t ^ 5 Pp^S^^K <* - 

[0 0 5 2] «±K)JliS^J-Ci4 1 V^yKOBiffefi ^> 
(^/^□Bi^fe^-) <D»-§-Sr^Lfc^, *^JSCaj05SiJ 
©-fft LT, S^^-t LT*7-ffii»Sr»^T?t 
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[0 0 5 3] *^^ijT-|i, T-^-D ym^-frA/D^te 
[0 0 5 4] HXtomMmx-te, Ifit'SlgSrffl^TJE;?' 

J; o xm^zmm-r z d t a* ^m^i&<D± >■->)-— =tmi 
im i ] *3g^jy£ftftiK i nmmiz&zm&mmn 

[02] ^-ffi^u^v'i^fijW^^troffl^^^Lfetft 
93 0 O 

[1213] tftm\/>i> t<Dm&*^tz.m 



14 



20 



[nu] *mwcom<DmMmzmzffiikmm<omf$.Z7F 
[0 5] *%w<Dm<DnMmimzm&mm<DMf&zfjk 

[0 6] h<DW)i¥?-( 5> 

[0 7] mi*iS^J{c*5tt5#3-^5/ Y<Dm<fey-J 5 v 

[08]MW^|g0-r)tc*5tt5#/±l^UVi>t^fiJW>^ 
tcDH^Sr^LTti^Uo 

[@9] f<!lcD^#i)(c:*5(j--5#tti^i u^^ir^-fij 
t offiflr^ L/ct£BJ0 o 

4-#£¥U£S (^S^WlE^a, I^^K^ffc, IE 
Z-jV-y ?T y-y°7--y*;V {% 

7 mmm^m 



[02] 



[0 3] 
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